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1.  INTRODUCTION 


This  report  Is  Intended  to  be  a  nontechnical  synthesis  of  a  large 
scale  field  Marketing  experiment  conducted  by  the  Wharton  Applied  Research 
Center  In  conjunction  with  the  United  States  Navy  Recruiting  Command.  The 
marketing  experiment  was  supported  by  three  sequential  research  contracts 
funded  through  the  Office  of  Naval  Research.  Additionally,  substantial 
funding  was  provided  by  the  Department  of  Defense  and  the  Navy  as  authorized 
by  the  Congress  to  effect  changes  In  advertising  expenditure  levels  and 
recruiter  presence  In  selected  market  areas.  Finally,  the  support  and  par* 
tlclpatlon  of  a  large  number  of  Individuals  and  organizations  from  the  defense 
manpower  network  were  necessary  for  the  completion  of  this  project.  This 
report  Is  aimed  at  providing  a  generalized  level  of  feedback  to  these  diverse 
groups. 

More  detailed  and  technical  representations  of  the  material  presented 
In  the  following  pages  Is  Included  In  the  other  six  volumes  that  comprise 
this  report  set.  A  brief  description  of  these  reports  Is  contained  in  the 
last  section  of  thl s  document. 

At  a  general  level,  we  would  urge  an  adaptive  stepwise  approach  to  the 
Implementation  and  application  of  the  findings  presented  here.  At  the  extreme, 
a  single  period  optimization  procedure  based  on  these  findings  would  require 
oversimplification  of  the  underlying  execution al  Issues  and  could  endanger 
long  term  recruiting  effectiveness.  This  danger  Is  present  because  of  several 
lags  which  are  embedded  In  the  current  system  and  which  condition  the  ability 
of  the  system  as  a  whole  to  adapt  to  new  conditions.  The  lags  Involved  In 
vary  In  nature  from  those  attendant  to  the  Congressional  budgeting  procedure 


to  those  Involved  In  deriving  benefit  from  an  expenditure.  Recruiter  learn¬ 
ing  periods  and  advertising  lead  tlaes  are  examples  of  the  latter.  Me 
believe  that  this  research  Is  dost  useful  to  provide  direction  for  stepwise 
policy  decisions.  Ideally  continued  testing.  Monitoring,  and  feedback  would 
accompany  such  changes. 

More  specifically,  then,  we  believe  that  Interpretation  and  application 
of  the  findings  outlined  In  this  report  can  be  best  approached  In  conjunction 
with  the  management  team  at  the  Navy  Recruiting  Command  and  with  the  Recruiting 
Resources  Allocation  Study  Steering  Group.  Both  of  these  groups  have  In-depth 
familiarity  with  the  research  agenda  presented  here  and  a  rich  appreciation 
of  the  broader  context  of  the  recruiting  environment. 


II.  OVERVIEW  OF  RESEARCH 
A.  Background 

This  research  effort  began  In  aid  1978  amid  Increasing  concerns  about  the 
ability  of  the  All  Volunteer  Force  to  meet  the  defense  manpower  requirements 
of  the  nation.  The  economy  was  up  and  enlistments  In  the  Armed  Forces  were 
down.  Several  services  (active  or  reserve)  confronted  enlistment  shortages 
and,  consequently,  shortages  In  ending  strength  levels.  The  quality  of  enlist 
ments  was  an  Issue  because  of  the  qualifying  test  scores  and  the  high  school 
graduation  status  of  enlistees.  Further,  the  population  of  18  year-olds  was 
reaching  a  cyclical  peak  and  demographic  forecasts  predicted  a  steady  decline 
of  the  prime  age  cohort  for  military  enlistments  (17-21  year-olds)  over  the 
next  decade. 

Among  the  alternative  responses  of  policymakers  to  these  concerns  was 
Increased  and/or  Improved  levels  of  comunlcatlons,  marketing  and  sales 
effectiveness  in  recruiting  enlistees.  The  cost-effectiveness  of  many 
existing  recruiting  programs,  however,  had  long  been  at  issue.  Recruiting 
and  advertising  budgets  fer  each  armed  service  were  Identified  as  special 
Interest  line  Items  In  the  congressional  budgeting  process.  Advertising  fer 
Armed  Service  enlistments  on  paid  electronic  media  had  been  recently  author¬ 
ized  by  Congress  (1976).  A  prototype  joint- services  advertising  campaign 
had  been  developed  and  was  being  seriously  debated.  Individual  service 
requests  for  budget  supplements  to  meet  threatened  enlistment  shortfalls 
proll fe rated. 

This  research  program  was  proposed  to  examine  the  general  question  of 
marketing  effectiveness  In  one  branch  of  the  Armed  Services  and  to  quantify. 

If  possible,  the  relationships  between  enlistment  achievement  and  marketing 
expenditures.  The  vast  majority  of  these  expenditures  are  concentrated  on  the 


Maintenance  and  support  of  the  field  recruiting  force  and  on  various  types 
of  paid  advertising. 


B.  Objective 

There  were,  then,  two  objectives  for  this  research  program  as 
follows: 

e  To  estimate  a  marketing  effort  response  curve  (as  measured  by  the 
number  of  Navy  enlistment  contracts  at  various  quality  levels)  to 
overall  changes  In: 

(a)  the  Navy  advertising  budget  level 

(b)  the  size  of  the  Navy  recruiting  force 

(c)  a  combined  change  In  both  policy  variables 

e  To  create  a  research  design  and  to  conduct  such  supplemental 
tracking,  data  collection  and  analyses  as  to  reasonably 
maximize  the  Information  about  other  recruiting  policies 
and  practices  that  effect  recruiting  success. 

C.  Methodology 

A  body  of  previous  or  concurrent  research  had  been  undertaken  by  the 
Navy  and  DOD.  These  Included  efforts  by  Femadez  [1],  Goldberg  [2],  Hanssens 
and  levlen  [3],  and  Morey  and  McCann  [4],  as  well  as  several  efforts  Internal 
to  the  Navy  Recruiting  Command  Itself  which  retrospectively  examined  the 
relationships  between  enlistments  and  various  factors. 

These  efforts  provided  valuable  Insights  and  direction  for  our  efforts. 
All  such  analyses  of  historical  data  are  constrained  to  some  degree  by  the 
nature  of  the  data  used,  however.  Conceptually,  three  constraints  were 
of  most  concern.  These  werr 
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1.  Independence.  Too  frequently  marketing  resources  are  allo¬ 

cated  based  on  sales  In  prior  periods.  It  Is  then  difficult 
to  determine  whether  marketing  effort  causes  sales  or  If 
sales  cause  marketing  efforts.  Further,  marketing  variables 
themselves  may  not  be  allocated  Independently  of  one  another. 
Recruiting  and  advertising  may  be  Increased  or  decreased  In 
the  same  market  or  at  the  same  times.  Effects  of  Individual 
variables  are  thus  difficult  to  ascertain. 

2.  Variance.  The  range  of  observation  for  a  given  marketing 

variable  Is  frequently  quite  narrow  In  historical  data. 

This  affects  the  usefulness  of  the  results  In  making 
decisions  beyond  current  policy  ranges. 

3.  Measurement.  Key  data  are  often  not  available  In  sufficient 

detail  or  disaggregation  for  analysis. 

To  counter  these  constraints  a  one  year  field  experiment  was  proposed 
as  follows: 

1.  Advertising  and  recruiters  were  to  be  varied  In  a  syste¬ 

matic  and  controlled  way.  They  were  to  be  varied  Inde¬ 
pendent  of  sales  In  prior  periods.  They  were  to  be 
varied  with  treatments  Independent  of  one  another. 

2.  A  broad  range  of  each  treatment  variable  was  to  be  tested  and 

treatments  were  to  be  replicated  In  multiple  markets. 

3.  A  substantial  body  of  supplemental  data  was  to  be  col¬ 

lected  for  each  market  Involved  In  the  experiment.  These 
Included  both  sales  and  marketing  data  for  the  other 
(competing)  branches  of  the  Armed  Forces.  In  addition 


a  two  wave  survey  research  program  was  to  be  conducted  In 
selected  markets  of  the  experiment. 


D.  Design 

The  Area  of  Dominant  Influence  (ADI)  was  selected  as  the  unit  of  anal¬ 
ysis  for  the  experiment.  Individual  counties  are  assigned  to  ADIs  by  the 
electronic  media-rating  services  based  on  media-use  patterns  of  sampled 
households.  ADIs  offered  the  most  reliable  way  of  executing  and  measuring 
the  changes  In  electronic  advertising  Incorporated  In  the  experiment. 

Of  the  over  200  ADIs  In  the  United  States  a  subset  was  selected  for 
experimental  treatment.  The  treatment  objective  was  to  expose  Individuals 
In  the  treatment  markets  to  the  level  and  type  of  advertising  and  recruiters 
to  which  they  would  be  exposed  under  the  alternative  budget  levels  being 
tested.  The  scheme  for  treatment  Is  represented  In  Figure  1. 

Figure  1 

DESIGN  OF  EXPERIMENT 
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Three  markets  were  assigned  to  each  of  the  11  treatment  conditions 
with  the  following  exceptions:  one  market  was  assigned  to  each  of  the 
100%  change  In  advertising  treatments;  an  additional  14  control  markets 
were  closely  monl tored— these  markets  received  no  change  In  either  re¬ 
cruiters  or  advertising.  Experimental  treatments  were  Imposed  In  26  markets, 
then,  and  a  total  of  43  markets  were  Involved  as  control  or  treatment 
markets. 

Individual  markets  were  assigned  to  treatment  conditions  by  the  Wharton 
Applied  Research  Center  team.  The  procedure  used  Included: 

e  Classifying  all  markets  In  terms  of  the  levels  of  Navy  enlist¬ 
ment  accessions  achieved  In  each  of  the  past  three  years.  This 
classification  examined  both  the  level  of  overall  military  enlist¬ 
ments  and  the  Navy's  share  of  those  enlistments  and  was  used  to 
match  markets. 

e  Excluding  from  consideration  a  number  of  markets  In  which 
special  enlistment  programs  were  being  field  tested.  These 
special  programs  Included  reduced  enlistment  tour  obligations 

and  enhanced  veterans  education  benefits. 

e  Excluding  from  consideration  a  small  set  of  markets  because 

of  technical  factors  such  as  the  amount  of  advertising 
"spilled"  out  of  the  market. 

e  Random  assignments  of  the  remaining  matched  markets  Into 
treatment  conditions.  This  Insured  that  markets  with  a 
variety  of  previous  "share"  and  "level"  conditions  were  ex¬ 
posed  to  each  treatment  condition. 

Figure  2  shows  the  actual  markets  selected  and  the  treatment  conditions 


Figure  2 

EXPERIMENTAL  MARKETS  AND  TREATMENT  CONDITIONS 
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From  Figure  2  we  see  that  Boston,  for  example,  was  to  receive  Increases 
In  both  advertising  and  recruiter  strength;  Los  Angeles  was  to  receive  no 
change  In  either  advertising  or  recruiter  strength,  and  Phoenix  was  to  receive 
decreases  In  each.  Markets  such  as  Washington,  Baltimore,  Chicago  and 
Harrisburg  were  to  receive  changes  In  just  one  treatment  variable. 

Additionally,  the  three  markets  in  each  of  the  four  corners  of  Figure  1 
were  used  as  the  sample  markets  for  the  two  wave  survey  research  program. 

The  questionnaire  battery  was  desired  to: 

e  Enable  the  Identification  of  any  obstruction  between  the  two 
marketing  control  variables,  recruiters  and  advertising.  It 
was  at  least  conceptually  possible  that  one  variable's 
effectiveness  could  be  offset  by  the  other. 

e  Provide  measures  of  the  Impact  of  recruiter  and  advertising 
treatment  on  a  range  of  Intermediate  measures.  These  measures 
Include:  awareness  of  advertising,  recruiter  contact,  atti¬ 
tudes  towards  a  variety  of  "life  goals",  perceptions  of  the 
Mavy,  and  Intentions  to  enlist  or  progress  In  the  recruiting 
process. 

e  Enrich  our  understanding  of  the  recruiting  environment  and 
process. 

To  achieve  these  alms,  respondents  were  sampled  at  a  variety  of  points 
In  the  recruiting  cycle.  Figure  3  graphically  presents  the  sampling  schema. 
Separate,  Independent  samples  were  drawn  at  each  point  In  the  process, 
questionnaires  were  administered  In  June  of  1979  (Wave  1)  before  any  experi¬ 
mental  Intervention  and  again  In  June  1980  (Wave  II),  nine  months  Into  the 
experiment.  The  general  target  population  questionnaire  was  administered  by 


SAMPLING  SCHEMA  FOR  QUESTIONNAIRE  ADMINISTRATION 


a  -  Sampling  point 

Two  •  •  Split  Sample— before  and  after  activity 


telephone  using  randan  digit  dialing  techniques.  All  other  questionnaires 
were  administered  by  Navy  Recruiting  or  AFEES  test  station  personnel  In  the 
fona  of  written  Instruments.  It  Is  useful  to  note  here  that  the  enlistment 
buying  cycle  Is  unique  In  that  It  Is  virtually  prescribed.  Enlistees  must 
proceed  to  each  stage  sequentially.  Table  1  outlines  the  major  groups  of 
questions  contained  In  both  the  written  and  telephone  questionnaires. 

Table  1 

QUESTIONNAIRE  GROUPS  OF  QUESTIONS 

I.  Demographics  of  respondents 

II.  Currrent  activity  of  respondent 
Planned  activity  of  respondent 

III.  The  Importance  of  various  factors  (life  goals) 
to  the  respondent  In  job  or  activity  selection 

IV.  Stated  likelihood  of  joining  the  Armed  Forces 
and  top  two  choices  by  Branch  of  Service 

V.  Perceptions  of  the  Armed  Forces  In  general 
and  the  Navy  In  particular  with  respect  to 
the  factors  (life  goals)  observed  In  Section  III 

VI.  Sources  of  Information  about  military  and  Navy 
enlistment  opportunities  and  programs 

E.  Execution 

To  execute  the  experlsr-tal  design,  the  test  budget  levels  first  had  to 
be  broken  out  Into  broad  program  areas  to  reflect  the  way  these  budget 
levels  would  actually  have  been  spent.  Table  2  presents  this  breakout  for 
the  advertising  budget  levels  being  tested.  Recall  that  the  design  concept 
was  to  expose  Individuals  In  treatment  markets  to  the  advertising  and  re> 
crulter  exposure  which  would  be  present  In  those  markets  If  the  test  budget 


1  national  program  allocations  In  millions  of  dollars 
'  percentage  of  budget  level  allocated  by  program 


levels  were  In  force.  Table  2  demonstrates  that  for  advertising,  consider¬ 
able  change  was  made  In  the  program  allocations  of  various  test  levels. 

These  decisions  were  made  by  the  Navy  Recruiting  Command  In  conjunction  with 
their  national  advertising  agency.  The  consensus  among  a  variety  of  reviewers 
was  that  the  allocation  schemes  were  very  well  grounded.  These  new  allocations 
were  then  translated  on  a  proportional  basis  Into  Individual  test  markets. 

For  recruiters  the  allocation  decision  was  more  straightforward.  The 
proposed  changes  In  recruiter  strength  were  determined  not  to  be  of  suffi¬ 
cient  magnitude  as  to  alter  the  current  basic  allocation  scheme.  Hence  pro¬ 
portional  Increases  or  decreases  In  recruiter  strength  were  targeted  for  each 
recruiter  treatment  market.  Targeted  changes  In  recruiter  strength  In  each 
market  were  then  executed  using  the  normal  rotation  process.  A  data  collection 
and  analysis  methodology  was  also  devised  to  control  for  recruiter  experience 
level. 


F.  Delivery 

Translating  design  and  execution  objectives  Into  reality  In  the  market¬ 
place  Is  not  trivial.  Maintaining  treatment  objectives  over  a  full  year 
Is  more  difficult  still.  Careful  monitoring  and  control,  as  well  as  sub¬ 
stantial  Command  attention  was  required  throughout  the  period  of  the  experi¬ 
ment.  Tables  3  and  4  present  the  actual  deliveries  of  treatment  variables 
achieved. 

The  deliveries  depicted  In  the  two  tables  met  the  design  and  execution 
objectives  of  the  research  program  extremely  well.  Independence,  variance, 
and  measurement  were  achieved.  Conformity  to  test  levels  was  essentially 
maintained.  These  achievements  are  more  Impressive  In  light  of  technical 
difficulties  encountered.  These  Included  the  Inability  to  cut  out  magazine 


Table  4 

DELIVERY  OF  TREATMENT  VARIABLES 
Recruiter  Treatment 


26  Intervention  Markets 
October  1979  to  September  1980 

(Average  Recruiters  per  Month  per  1,000  Target  Population  Males) 


Low  Recruiter  No  Change  High  Recruiter 
_ Markets _ Markets  Markets 

Navy  .241  .330  .349 

Recruiters  (.131  to  .329)  (.236  to  .480)  (.271  to  .672) 


Other  Service 

Recrul ters 

.546 

.547 

.653 

Total 

Recrul ters 

.787 

.877 

1.002 

Average  Total 

Navy  Adver¬ 
tising  Dollars 
(National  and  Local) 
per  1,000  Target 
Population 

55.48 

59.70 

47.59 

Parentheses  denote  range 


advertising  In  low  treatment  markets  or  to  Increase  It  In  high  markets,  the 
continuation  of  officer- targe ted  advertising  In  all  markets,  and  the  vagaries 
of  household  viewing  patterns.  Conformity  to  recruiter  treatments  required 
combating  attrition  from  recruiting  duty,  failure  at  recruiter  school. 

Injury  and  Illness  among  recruiters,  as  well  as  other  human  and  personnel 
difficulties. 


G.  Analysis 

A  substantial  and  detailed  data  base  was  developed  for  each  market 
(ADI)  Involved  In  the  field  experiment.  Data  was  collected  In  both  treat¬ 
ment  and  control  markets  for  each  month  of  the  Intervention  period.  Table  5 
presents  an  overview  of  the  data  collected  about  each  market. 

In  addition,  a  separate  data-set  comprised  of  coded  responses  to  the 
survey  questionnaires  was  accumulated.  Approximately  8,000  completed, 
returned,  and  coded  questionnaires  are  Included  In  this  set. 

Four  separate  analyses  of  the  experimental  data  were  conducted  using 
appropriate  components  of  the  data  base.  These  analyses  are  listed  below. 

1.  Analysis  of  Variance  (ANOVA)  was  conducted  to  Investigate 

the  main  effects  of  advertising  and  recruiter  strength 
treatments,  explore  a  variety  of  co-variates,  and  Inves¬ 
tigate  Interaction  effects  between  advertising  and 
recruiters. 

2.  Aggregate  Cross-Sectional  demand  equation  models  were  fitted 

to  the  data  since  actual  deliveries  of  treatment  condi¬ 
tions  were  continuous  rather  than  discrete.  Data  were 
aggregated  across  the  entire  period  of  observation  (one 
year)  to  maximize  Independence  and  enable  the  derivation 
of  long  run  elasticities. 


Table  5 

DATA  BASE  OVERVIEW 


Category 


Data  Elements 


Military  Enlistment 
Contracts 


Department  of  Defense  enlistment  con- 
tracts  and  Navy  enlistment  contracts 
disaggregated  by  high  school  graduation 
status ,  mental  group  categories,  gender 
and  race. 


Environmental 

Factors 


Employment  and  unemployment  among  the 
labor  force  In  the  markets.  Income, 
degree  of  urbanization,  and  racial 
representation  in  the  markets. 


Navy  Recruiting 
Marketing  Factors 


Total  number  of  Navy  recruiters  by 
person  and  by  person  month;  recruiters 
beginning  or  ending  their  duty  tours; 
DEP  position  as  a  percent  of  quota; 
Navy  and  joint  service  advertising 
dollar  expenditures  and  delivered  Im¬ 
pressions  by  media  type;  Navy  local 
advertising  expenditures. 


Competitive 

Factors 


Recruiters  and  advertising  expenditures 
as  reported  by  the  Anay.  Air  Force,  and 
Marines. 


9 


3.  Ratio  analyses  were  conducted  to  Introduce  a  dynamic  dimen 
slon  to  the  analyses.  Furthermore,  observations  were 
standardized  by  the  mean  and  variance  of  each  market's 
past  (pre- Intervention)  performance. 

4.  Moving  Cross-Sectional  and  Pooled  Time  Serles/Cross-Sectlonal 
models  were  fitted  to  the  data.  This  enabled  the  examin¬ 
ation  of  lag  structures  for  several  of  the  key  variables, 
and  the  possibility  of  the  time  varying  effectiveness  of 
each. 

Finally,  questionnaire  data  was  analyzed  by  examining  the  wave  to  wave 
change  In  the  responses  of  Interest.  In  this  way  each  market  or  treatment 
cell  served  as  Its  own  control. 

Key  results  from  both  the  experimental  and  questionnaire  analyses  are 
presented  In  the  next  section  of  this  report.  It  should  be  mentioned  that 
compilation  of  the  data  bases  described  above  can  be  considered  as  an  Important 
by-product  of  this  research  program.  Investigation  of  a  variety  of  supplementary 
Issues  should  be  quite  feasible  from  this  data. 
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111.  SUMMARY  OF  KEY  FINDINGS 

This  section  summarizes  the  results  of  the  one-year  controlled  field 
experiment  In  which  the  levels  of  field  recruiters  and  advertising  budget 
were  systematically  varied  by  the  Navy  Recruiting  Command.  The  numbers  of 
Navy  and  military  enlistment  contracts  achieved  In  the  treatment  markets 
were  analyzed  with  respect  to  these  systematic  variations.  In  addition 
to  the  experimental  treatment,  a  two-wave  survey  questionnaire  was  administered 
In  selected  experimental  markets.  Both  the  specified  experimental  treatments 
and  the  survey  program  were  effectively  delivered  by  the  Navy  Recruiting 
Command.  Analysis  of  the  questionnaire  responses  was  conducted  and  Is  Inte¬ 
grated  with  the  experimental  results.  Key  findings  from  these  analyses  are 
reported  below,  classified  Into  categories  as  follows: 

1.  Findings  related  to  the  two  experimental  variables,  advertising 
expenditure  and  recruiter  strength; 

2.  Findings  related  to  other  variables  of  the  recruiting  process,  such 
as  relative  shares  among  the  services,  and  recruiting  quotas; 

3.  Effects  on  recruiting  efforts  of  factors  such  as  unemployment  rates, 
which  are  outside  the  control  of  the  recruiting  system; 

Finally,  computations  of  marginal  costs  per  enlistment  contract  for 
recruiter  and  advertising  expenditures  are  sunaarlzed.  The  section  ends 
with  several  cautions  fbr  Interpreting  these  results. 

1.  Recruiter  strength  was  observed  to  have  significant  effects  on  the  number 
of  enll stment  contracts  obtained. 


Enlistment  Effects:  Highly  significant  relationships  between  the  number 
of  recruiters  present  and  the  nunber  of  enlistment  contracts  signed 
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were  observed  for  all  Mavy  contract  types  Investigated.  These 
relationships  were  observed  through  each  of  the  four  methods  of 
analysis  employed,  except  for  enlistment  contracts  slyied  by 
Black  Individuals  which  was  found  In  only  one  method. 

Market  Expansion:  Very  strong  Indications  of  market  expansion  as  well 
as  "brand  switching"  were  evident  for  Increased  Navy  Recruiter  levels. 
That  Is,  Increasing  the  numbers  of  Navy  recruiters  Increases  the 
Navy's  relative  share  of  enlistments  --  and  It  also  Increases  the 
total  number  of  military  enlistment  contracts  obtained. 

Learning  Period:  A  four  to  six  month  learning  period  for  newly-assigned 
Navy  recruiters  was  found.  Enlistment  contract  production  for  new 
recruiters  during  this  period  Is  substantially  less  than  that  of 
more  tenured  recruiters.  This  suggests  that  a  lagged  response  to 
new  recruiter  Input  should  be  anticipated  by  military  manpower  planners. 

De-Learning  Period:  A  "de-learning"  period  was  noted  for  Navy  recruiters 
who  expected  soon  to  leave  recruiting  duty.  In  one  analysis,  enlist¬ 
ment  contract  production  fell  off  sharply  beginning  about  one  year 
before  tour  rotation.  This  phenomenon  (should  It  continue  despite 
efforts  to  correct  It)  would  greatly  exacerbate  the  productivity 
loss  Incurred  by  rotating  recruiting  duty  among  other  military  assig¬ 
nments,  because  recruiters  would  be  performing  at  below-average 
rates  for  roughly  one-half  their  duty  tours. 

Intermediate  Measures:  Statistically  significant  differences  on  a  broad 
range  of  Intermediate  measures  were  observed  when  markets  with 
Increased  recruiter  strength  were  compared  with  markets  with  decreased 
recruiter  strength  and/or  when  pre-recrul ter  samples  were  compared 
with  post-recruiter  samples.  These  Intermediate  measures  Include: 
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(a)  Reported  contact  with  military  recruiters 

(b)  Reported  perceptions  of  the  Navy 

(c)  Stated  Intentions  to  take  the  Armed  Forces  qualifying 
test  battery 

(d)  Reported  length  of  enlistment  contracts  signed 

Market  Segments:  Distinct  segments  of  the  youth  population  can  be  dis¬ 
tinguished  by  their  attitudes  toward  various  career  goals.  Variations 
in  recruiter  strength  are  associated  with  differences  In  the  pro¬ 
portions  of  Navy  enlistees  drawn  from  these  segments.  It  can  be 
Inferred  that  Navy  recruiters  are  relatively  more  effective  In  re¬ 
cruiting  Individuals  with  certain  life  or  career  goals. 


2.  Advertising  expenditures  were  observed  to  have  significant  effects  on 
the  number  of  enlistment  contracts  obtained. 


Enlistments:  Statistically  significant  relationships  between  the  number 
of  several  types  of  enlistment  contracts  signed  *nd  several  types  of 
advertising  expenditures,  Including  positive  effects  of: 

(a)  Navy  local  advertising  with  respect  to  Navy  high  school  diploma 
graduate  enlistment  contracts  (56.4%  of  all  contracts  observed 
were  high  school  diploma  graduates) 

(b)  Joint  Services  advertising  expenditures  with  respect  to  Navy 
enlistment  contracts  signed  by  Individuals  classified  In 
mental  groups  I  through  III  upper  (43.6%  of  all  contracts 
observed) 

(c)  Total  reported  Armed  Services  advertising  expenditures  (joint 
and  Individual  services)  with  respect  to  total  Defense  Department 
enlistment  contracts 

Market  Expansion:  Strong  Indications  of  “market  expansion"  as  well  as 
"brand  switching"  were  evident  for  Increases  In  several  categories 
of  advertising  expenditures. 


Lagged  Effects:  Very  small  (but  statistically  significant)  effects  for 
Navy  national  advertising  expenditures  on  enlistment  contracts  were 
observed  for  some  periods  and  with  respect  only  to  non-high  school 
diploma  graduate  enlistment  contracts  (69.0%  of  all  contracts  observed) 
The  observations  suggest  that  the  effects  are  "lagged- ,  that  Is, 
they  occur  from  three  to  four  months  after  advertising  treatment. 
Intermediate  Measures:  Virtually  no  statistically  significant  differ¬ 
ences  on  a  broad  range  of  Intermediate  measures  were  observed  when 
markets  which  received  Increased  levels  of  Navy  advertising  expendi¬ 
tures  were  compared  with  markets  which  received  decreased  Navy  adver¬ 
tising  expenditures.  The  Intermediate  measures  Include: 

(a)  Stated  awareness  of  military  or  Navy  advertising  (awareness  of 
military  advertising  approached  80%  of  respondents  regardless 
of  treatment) 

(b)  Reported  perceptions  of  the  Navy 

(c)  Stated  Intentions  to  join  the  military  or  Navy 

(d)  Reported  contact  with  military  or  Navy  recruiters 

(e)  Reported  length  of  enlistment  contract  signed 

(f)  Stated  likelihood  to  progress  In  the  recruitment  process 
Market  Segments:  Distinct  segments  of  the  youth  population  can  be  dis¬ 
tinguished  by  their  attitudes  toward  various  career  goals.  Signifi¬ 
cant  differences  in  the  relative  proportions  of  these  segments  among 
those  who  signed  Navy  enlistment  contracts  are  associated  with  vari¬ 
ations  In  advertising  treatments.  It  can  be  Inferred  that  Navy 
advertising  has  a  differential  Impact  on  the  identified  segments. 
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3.  Other  factors  endogenous  to  the  recruiting  system  Mere  observed  to  have 
effects  on  the  muter  of  enlistment  contracts  obtained. 


Delayed  Entry  Fool:  A  strong  effect  of  Delayed  Entry  Pool  size  as  a  per¬ 
cent  of  quota  was  observed  for  high  school  diploma  graduate  and  upper 
mental  group  enlistment  contracts.  Reduced  relative  DEP  positions 
were  significantly  associated  with  lower  contract  achievement  for 
these  types  of  enlistment  contracts.  The  converse  was  found  for 
Increased  relative  DEP  positions. 

Prior  Market  Share:  The  relationship  between  achieved  enlistment  con¬ 
tracts  and  both  controlled  and  uncontrolled  variables  Is  significantly 
different  In  markets  In  which  the  Navy  has  had  a  large  market  share 
as  compared  to  markets  In  which  the  Navy's  share  has  been  smaller. 

This  suggests  that  marketing  efforts  may  have  differential  effects 
between  these  market  typos. 

Prior  Military  Enlistment  Level:  Demand  equation  models  of  Navy  enlist¬ 
ment  contract  performance  fit  the  data  substantially  better  In  markets 
where  the  level  of  military  enlistments  had  been  low  In  the  past 
when  compared  with  markets  In  which  military  enlistments  had  been 
high  In  the  past.  This  phenomenon  was  not  observed  for  DOD  contracts 
In  general.  This  suggests  the  possibility  that  Navy  enlistment 
contracts  In  "high  level”  markets  are  being  artificially  constrained 
by  the  goal  or  quota  system  applied  to  these  markets. 

Diminishing  Returns:  Non-linear  exponential  models  provided  better  fits 
to  the  data  In  the  aggregate  than  did  linear  models.  This  Is  broadly 
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Indlcatlve  of  diminishing  Marginal  productivity  (In  terns  of  enllst- 
nent  contracts)  of  Inputs  (recruiters  and  advertising*  for  example). 


4.  Broader  socio-economic  factors  outside  the  direct  control  of  the  Navy  or 
Armed  Forces  recruiting  system  had  significant  effects  on  enlistments. 

Unemployment  Rates:  Unemployment  rates  among  the  general  population  In 
treatment  markets  had  a  strong  Impact  on  Navy  recruiting  efforts. 
Armed  Forces  recruiting  can  be  characterized  as  counter-cyclic 
with  higher  unemployment  rates  associated  with  higher  rates  of 
enlistment.  The  ratio  of  these  rates  Is  estimated  at  about  five 
to  one.  That  Is,  an  Increase  In  the  unemployment  rate  of  one 
percent  Is  estimated  to  lead  to  a  five  percent  Increase  In  Navy 
enlistments.  It  should  be  further  noted  that  this  ratio  would  be 
substantially  magnified  If  fleet  re-enlistment  (retention)  decisions 
are  also  counter-cyclical.  If  the  effect  of  unemployment  on  retention 
were  to  be  the  same  as  on  recruiting,  then  a  one  percent  change  In 
the  unemployment  rate  could  be  expected  to  Induce  a  ten  percent 
change  In  enlistment  achl evement— the  five  percent  change  In  first 
enlistments  plus  the  estimated  change  In  recruiting  requirements 
determined  by  the  change  In  fleet  retention  rates. 

Educational  Enrollment:  School  status  as  well  as  employment  status 
among  the  general  youth  population  seems  related  to  enlistment 
activity.  Roughly  50  percent  of  Individuals  sampled  who  were 
taking  the  Armed  Forces  qualifying  test  battery  and  approximately 
70  percent  of  those  sampled  who  signed  enlistment  contracts  during 


our  sample  period  (June  1979  and  June  1980)  reported  that  they 
were  not  working  and  not  In  school.  This  compares  to  about  10 
percent  of  young  people  In  general  who  were  sanpled  at  the  sane 
times.  This  mqy  Imply  that  recruiting  will  be  affected  by  changes 
In  policies  affecting  educational  access  (such  as  student  loan 
provisions). 

Urbanization:  Saal 1  effects  of  urbanization  and  1 ncome  were  observed 
for  high  school  diploma  graduate  enlistment  contracts.  It  seems 
likely  that  both  Income  and  high  school  performance  are  systema¬ 
tically  related  to  urbanization.  Higher  levels  of  such  enlist¬ 
ment  contracts  were  observed  for  more  urban  markets. 

6endor  Effects:  Men  and  women  respond  to  the  recruiting  environment 
In  very  different  ways.  Female  questionnaire  respondents  were 
less  effected  by  recruiter  contact  and  had  a  significantly  differ¬ 
ent  response  to  advertising  than  male  respondents.  In  general, 
women's  perceptions  of  the  Navy  Improved  where  advertising  was 
decreased.  Further,  men  and  women  differed  significantly  In 
their  responses  to  a  majority  of  questionnaire  Items.  This 
Implies  that  marketing  campaigns  need  to  be  evaluated  with 
respect  to  the  gender-related  objectives  of  defense  planners. 


Marginal  costs  for  achleveaient  of  enlistment  contracts  of  various 
types  through  recruiting  resource  expenditures  were  estimated  for  those 


resources  which  had  consistent  and  significant  effects  on  contracts. 
Elasticities  derived  from  cross-sectional  analyses  were  used  for  this 
purpose.  Cost  estimates  from  this  type  of  analysis  can  be  viewed  as  long 
run  estimates.  The  key  results  presented  below  are  valid  In  the  ranges  of 
variation  of  the  recruiting  resources  tested  or  observed.  The  ranges  vary 
from  a  ratio  (highest  spending  to  lowest  spending)  of  twenty- to-one  for 
Navy  national  advertising,  down  to  a  ratio  of  two- to-one  for  joint  services 
advertlsl ng. 

Recruiters  show  the  strongest  and  most  consistent  effects  on  enlist¬ 
ment  contract.  Hence,  Investments  In  recruiter  resources  bear 
relatively  less  financial  risk.  They  are  also  the  most  expensive 
resource  Input  at  the  margin.  A  cost  per  enlistment  contract  for 
recruiter  Input  was  estimated  at  about  $2,000  compared  with  an  average 
cost  of  marketing  Inputs  per  enlistment  contract  across  our  obser¬ 
vations  of  about  $1,000.  The  marginal  cost  per  contract  achieved 
through  recruiter  Input  rises  steadily  with  "quality"  constraints. 

A  high  school  diploma  graduate  enlistment  contract  Is  estimated  at 
$3,300  and  a  mental  group  one  or  two  enlistment  contract  at  about 
$6,300.  The  above  calculations  use  a  cost  per  recruiter  estimate  of 
$30,000  per  year. 

Advertising  effects  on  enlistment  contracts  are  not  as  strong  or  consis¬ 
tent  as  those  for  recruiters.  These  expenditures  are  thus  "riskier”. 
Nevertheless,  where  effective,  advertising  Is  highly  efficient. 

The  lowest  marginal  cost  estimated  Is  for  Navy  local  advertising 
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wlth  respect  to  Navy  high  school  dlplaea  graduate  contracts.  The 
cost  Is  estimated  at  $200  per  contract.  The  marginal  cost  per  Navy 
enlistment  contract  for  Joint  Services  advertising  expenditures  Is 
generally  under  $1,000.  Marginal  costs  fer  Navy  national  advertising 
were  not  estimated  because  aggregate  effects  were  very  small  and 
Inconsistent  fbr  this  campaign.  Hence  marginal  costs  for  this 
resource  would  be  exceptionally  high. 

Cautions  Needed 

Finally,  the  reader  should  observe  several  cautions  In  evaluating 
these  findings. 

e  The  general  market  conditions  under  which  this  research  was  conducted 
condition,  to  same  extent,  the  nature  of  the  findings.  It  Is  doubtful, 
for  example,  that  these  analyses  would  be  appropriate  or  useful  as 

policy  guidelines  during  time  of  war. 

e  The  extrapolation  of  these  results  beyond  the  range  of  data  observed 

Is  unwarranted. 

e  More  subtly.  Implicit  In  the  findings  and  research  conducted  are  a 
substantial  number  of  management  decisions  and  assumptions.  These 
decisions  Include:  the  creative  and  media  allocation  strategies  In 
advertising;  the  underlying  deployment  strategy  for  recruiters;  and 
an  entire  set  of  policies  and  control  mechanisms  for  goal  setting, 
performance  evaluation,  and  feedback.  A  different  set  of  decisions 
with  respect  to  these  factors  could  be  expected  to  yield  different 
results.  Since  the  Introduction  of  the  All  Volunteer  Force  steady 
progress  with  respect  to  these  decisions  has  been  evidenced  by  the 
Navy  Recruiting  Comnand.  This  progress  has  been  abundantly  clear 
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IV.  A  NAVY  ENLISTMENT  FIELD  MARKETING  EXPERIMENT 

Guide  to  t At  Volumes  of  this  Report 

Tht  Wharton  Applied  Research  Center  has  prepared  seven  voIums  of  re¬ 
ports  on  the  Navy  Enlistment  Field  Experiment.  The  series  begins  with  an 
overview  and  summary  of  hypotheses.  experiments,  and  significant  results. 
Volume  II  contains  an  Integrated  report  on  the  experimentally-tested  relation¬ 
ships  between  controllable  marketing  variables  and  Navy  accessions.  Volume 
III  presents  a  related  Investigation  of  Navy  recruiter  productivity. 

The  remaining  four  volumes  present  descriptions  and  analyses  of  a  "track¬ 
ing"  study  designed  to  measure  the  relationships  between  demographic  and 
"Intermediate"  attltudlnal  and  perceptual  measures  and  controllable  marketing 
efforts. 

The  relationships  between  the  various  volumes  are  shown  In  the  diagram. 
As  an  aid  to  the  reader,  a  brief  description  of  the  contents  of  each  volume 
Is  presented  below. 
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Volume  II.  The  Field  Experl went:  Design,  Execution,  Delivery  and  Analysis 
This  volume  contains  a  detailed  discussion  of  the  background  and  objectives  of 
the  research.  The  development  of  an  appropriate  experimental  design,  the 
choice  of  variables  and  test  markets,  the  levels  of  experimental  treatments 
and  so  forth  Is  also  discussed.  The  execution  of  the  experimental  protocol 
Is  recounted.  This  Is  followed  by  a  detailed  description  of  the  collected 
data,  and  of  analyses  Including  aggregated  ANOVA  and  a  variety  of  multiple 
regression  models.  An  Investigation  of  month-by-month  response  rates  using 
standardized  log  ratio  analysis  and  monthly  as  well  as  cross-sectional  time 
series  analysis  Is  also  reviewed. 

Volume  Ill.  An  Empirical  Investigation  of  Mavy  Recruiter  Productivity  - 
A  discussion  of  the  problems  and  Issues  of  salesforce  productivity  measurement 
begins  this  volume.  After  presentation  of  the  data  on  which  the  Investigation 
Is  based,  observed  "learning"  and  "de-learning"  effects  are  described.  Other 
significant  phenomena  are  also  discussed,  among  them  the  effects  of  recruiting 
goals,  differences  between  regions  and  Involuntary  extensions  of  recruiters' 
duty  tours.  The  observed  frequency  distribution  of  recruiter  productivity  Is 
presented.  This  Is  followed  by  a  discussion  of  recruiter  performance  fore¬ 
casting,  and  by  suggestions  for  future  research. 

Volume  IV.  The  Wharton-Administered  Havy  Tracking  Study:  Design  and 
Execution  -  This  volume  outlines  the  rationale  and  methodology  for  collecting 
and  evaluating  so-called  "Intermediate"  measures  of  marketing  effectiveness. 
Selection  of  data  collection  vehicles,  choice  of  measurement  variables  and 
ranges  and  preparation  of  survey  Instruments  are  discussed.  Response  rates 
and  other  relevant  details  of  the  mechanics  of  data  collection  are  outlined. 
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An  apppendlx  contains  copies  of  the  survey  Instruments. 

Volume  V.  The  Wharton-Adml nl stered  Navy  Tracking  Study:  Pre-Intervention 
Recruiting  Environment  -  Demographic,  attltudlnal  and  perceptual  data  are 
presented  In  this  volume  (a)  for  the  at-large  population  of  young  people,  as 
sampled  hy  telephone  survey,  and  (b)  for  participants  In  the  recruiting  cycle 
Itself,  as  sampled  through  written  questionnaires.  A  baseline  Is  thus 
established  for  understandl ng  of  further  studies.  The  cross-sectional  view 
of  the  recruiting  process  leads  to  Insights  Into  Its  mechanisms.  Complete 
tabulations  of  the  collected  data  are  appended. 

Volume  VI.  The  Wharton-Administered  Wavy  Tracking  Study:  Hierarchical 
Analysis  of  Recruiter  and  Advertising  Treatment  Level  Effects  -  This  volume 
focuses  on  measurement  of  changes  In  Intermediate  variables  —  attitudes 
and  perceptions  —  which  may  be  ascribed  to  military  marketing  activities. 
Differences  across  the  experimental  period  are  evaluated  with  respect  to 
variations  In  advertising  and  recruiter  strength  levels.  Cross  sectional 
differences  using  post-experimental  data  are  also  examined.  An  appendix 
presents  complete  tabulations  of  the  examined  data. 

Volume  VII.  The  Wharton -Adml nl stered  Wavy  Tracking  Study:  A  Segmentation 
Approach  •  Multivariate  cluster  analysis  has  been  applied  to  the  collected 
attltudlnal  data  to  determine  the  nature  and  size  of  Identifiable  market 
segments  and  Me  at-large  population  of  young  people.  This  volume  outlines 
the  technique  and  results  of  the  study,  then  evaluates  the  differential 
rates  at  which  the  observed  segments  proceed  through  the  Navy  recruiting 
process.  Differences  which  may  be  associated  with  variations  In  experimental 
treatment  conditions  are  also  Identified. 
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